Multi-scale and multi-patch transformer for sandstorm image enhancement

Sandstorm is a meteorological phenomenon common in arid and semi-arid regions. A sandstorm can carry large volumes of sand unexpectedly, which leads to severe color deviations and significantly degraded visibility when an image is taken in such a scenario. However, existing image enhancement methods cannot enhance sandstorm images well due to the challenging degradations and the scarcity of sandstorm training data. In this paper, we propose a Transformer with rotary position embedding to perform sandstorm image enhancement via building multi-scale and multi-patch dependencies. Our key insights in this work are 1) a multi-scale Transformer can globally eliminate the color deviations of sandstorm images via aggregating global information, 2) a multi-patch Transformer can recover local details well via learning the spatial variant degradations, and 3) a U-shape Transformer with rotary position embedding as the core unit of multi-scale and multi-patch Transformer can effectively build the long-range dependencies. We also contribute a real-world Sandstorm Image Enhancement (SIE) dataset including 1,400 sandstorm images with different degrees of degradations and various scenes. Experiments performed on synthetic images and real-world sandstorm images demonstrate that our proposed method not only obtains visually pleasing results but also outperforms state-of-the-art methods qualitatively and quantitatively.     

高光谱成像用高帧频CMOS图像传感器北大核心

针对高帧频、全局曝光和光谱平坦等成像应用需求,设计了一款高光谱成像用CMOS图像传感器。其光敏元采用PN型光电二极管,读出电路采用5T像素结构。采用列读出电路以及高速多通道模拟信号并行读出的设计方案来获得低像素固定图像噪声(FPN)和非均匀性抑制。芯片采用ASMC 0.35μm三层金属两层多晶硅标准CMOS工艺流片,为了抑制光电二极管的光谱干涉效应,后续进行了光谱平坦化VAE特殊工艺,并对器件的光电性能进行了测试评估。电路测试结果符合理论设计预期,成像效果良好,像素具备积分可调和全局快门功能,最终实现的像素规模为512×256,像元尺寸为30μm×30μm,最大满阱电子为400 ke^(-),FPN小于0.2%,动态范围为72 dB,帧频为450 f/s,相邻10 nm波段范围内量子效率相差小于10%,可满足高光谱成像系统对CMOS成像器件的要求。     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

Experimental study on uplift behavior of shallow anchor plates in geogrid-reinforced soil

Geogrid reinforcement can significantly improve the uplift bearing capacity of anchor plates. However, the failure mechanism of anchor plates in reinforced soil and the contribution of geogrids need further investigation. This paper presents an experimental study on the anchor uplift behavior in geogrid-reinforced soil using particle image velocimetry (PIV) and the high-resolution optical frequency domain reflectometry (OFDR). A series of model tests were performed to identify the relationship between the failure mechanism and various factors, such as anchor embedment ratio, number of geogrid layers, and their location. The test results indicate that soil deformation and the uplift resistance of anchor plates are substantially influenced by anchor embedment ratio and location of geogrids, whereas the number of geogrid layers has limited influence. In reinforced soil, increasing the embedment ratio greatly improves the ultimate bearing capacities of anchor plates and affects the interlock between the soil and geogrids. As the embedment depth increases, the failure surfaces gradually change from a vertical slip surface to a bulb-shaped surface that is limited within the soil. The strain monitoring data shows that the deformations of geogrids are symmetrical, and the peak strains of geogrids can characterize the reinforcing effects.     

Accelerating BPC-PaCo through Visually Lossless Techniques

Fast image codecs are a current need in applications that deal with large amounts of images. Graphics Processing Units (GPUs) are suitable processors to speed up most kinds of algorithms, especially when they allow fine-grain parallelism. Bitplane Coding with Parallel Coefficient processing (BPC-PaCo) is a recently proposed algorithm for the core stage of wavelet-based image codecs tailored for the highly parallel architectures of GPUs. This algorithm provides complexity scalability to allow faster execution at the expense of coding efficiency. Its main drawback is that the speedup and loss in image quality is controlled only roughly, resulting in visible distortion at low and medium rates. This paper addresses this issue by integrating techniques of visually lossless coding into BPC-PaCo. The resulting method minimizes the visual distortion introduced in the compressed file, obtaining higher-quality images to a human observer. Experimental results also indicate 12% speedups with respect to BPC-PaCo.     

安卓平台上的医用图像信息采集系统的开发设计

为了探讨在安卓平台上构建医用图像采集系统的开发个案,分析通过以智能手机、平板电脑为核心安卓设备通过拍照获得化验单数据后进行文本识别并提交智慧医疗系统的解决方案。本文首先通过二值化算法形成低阈值图像数据,使用卷积神经元网络算法对文本进行逐一识别,使用K-means算法对识别后的单字文本进行字段记录值的整合并形成元数据库服务于其他智慧医疗系统模块。在使用9000组数据对神经元网络进行前期训练的前提下,该系统的识别准确率达到了99.5%以上。本系统具有一定的可行性,对未来智慧医疗的系统开发有实践意义。     

Quality assessment for color correction-based stitched images via bi-directional matching

With the deepening of social information, the panoramic image has drawn a significant interest of viewers and researchers as it can provide a very wide field of view (FoV). Since panoramic images are usually obtained by capturing images with the overlapping regions and then stitching them together, image stitching plays an important role in generating panoramic images. In order to effectively evaluate the quality of stitched images, a novel quality assessment method based on bi-directional matching is proposed for stitched images. Specifically, dense correspondences between the testing and benchmark stitched images are first established by bi-directional SIFT-flow matching. Then, color-aware, geometric-aware and structure-aware features are respectively extracted and fused via support vector regression (SVR) to obtain the final quality score. Experiments on our newly constructed database and ISIQA database demonstrate that the proposed method can achieve comparable performance compared with the conventional blind quality metrics and the quality metrics specially designed for stitched images.